[GLUTEN-12053][CELEBORN] Bump Celeborn version to 0.6.3#12057
Conversation
|
Run Gluten Clickhouse CI on x86 |
|
Run Gluten Clickhouse CI on x86 |
|
Run Gluten Clickhouse CI on x86 |
|
Ping @jackylee-ch, @kerwin-zk. |
| .getClass() | ||
| .getDeclaredMethod("prepareForMergeData", Integer.TYPE, Integer.TYPE, Integer.TYPE); | ||
| prepareMethod.invoke(shuffleClient, shuffleId, mapId, attemptId); | ||
| } catch (NoSuchMethodException ignored) { |
There was a problem hiding this comment.
should we have a warning for this?
There was a problem hiding this comment.
@jackylee-ch, it's unnecessary to log warning for this. This interface is removed from 0.6.3. In addtion, other method invokers also do not log warning for NoSuchMethodException.
| "mapperEnd", Integer.TYPE, Integer.TYPE, Integer.TYPE, Integer.TYPE); | ||
| mapperEndMethod.invoke(shuffleClient, shuffleId, mapId, attemptId, numMappers); | ||
| } | ||
| } catch (NoSuchMethodException ignored) { |
|
The ClickHouse CI failed with |
| } | ||
| } | ||
|
|
||
| public static void prepareForMergeData( |
There was a problem hiding this comment.
We should cache reflection methods to avoid creating them on every call.
There was a problem hiding this comment.
@wForget, this improvement would be implemented in another pull request.
There was a problem hiding this comment.
@wForget, this improvement would be implemented in another pull request.
Could you create an issue to track this first?
4 participants
What changes are proposed in this pull request?
Bump Celeborn version to 0.6.3. Backport:
ShuffleClient#mapperEnd.ShuffleClient#prepareForMergeData.Fixes: #12053.
How was this patch tested?
CI.
Was this patch authored or co-authored using generative AI tooling?
No.